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ABSTRACT 

The paper surveys the costs of interest-inventory 
revision and concludes that, ultimately, the elimination of sex bias 
in career interest inventories will depend on project funding. After 
the issues of criterion sample, item pool, instructional orientation, 
interpretation, and legality have been settled, researchers and 
publishers will have the guidelines necessary for removing, or at 
least minimizing, sex bias in the use and interpretation of interest 
inventories. Then attention must focus on the issue of finances. 
Funding must include a yearly $75,000 to $80,000 allowance for 
personnel. Construction of one empirical occupational scale costs 
$1,900 to $2,000, complete revision of an interest inventory costs a 
minimum of $270,000, with publishing expense bringing the total to 
$385,000. Three years is the absolute minimum estimate for a complete 
revision. Financial support for researchers must increase. Possible 
funding sources include publishers, universities, and scoring 
services; Federal government; professional organizations: and special 
interest groups. (Author/A jy 
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Costs of Developing Interest Inventories 
and Implications for Change 



Oo-Ida C. Hansen 
Center for Interest Measurement Research 
University of Minnesota 

« 

In the Preface of Vocational Interests of Men and Vlomen (1943), 
E. K. Strong, Jr. acknowledged two major financial contributions that 
subsidized his investigation of vocational interests and the development 
of the Strong Vocational Interest Blank (SVIB): $18,000 received from the 
Carnegie Corporation in 1935 and $27,400 in grants from the Council of 
Research in the Social Sciences spread over a period of years. 

Thirty years later, the development of a new interest inventory 
has a projected budget of $340,000 and an anticipated time schedule of 
three years; interest inventory revisions, which once dragged on for as 
long as thirteen years, now are completed in three compact, intense years. 

Authors and publishers, previously motivated internally to 
update and better their tests, are urged to revise by psychologists, 
educators, lawyers and students, who express interest in the psychometric 
quality, the legality, and the usefulness of interest Inventories for 
career education, for vocational decision-making, and for generating 
occupati onal opportuni ti es . 
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No longer may the vocational Interest researcher casually decide, 
»I think the tiir.e has ccrr.e for a revision; twenty years have passed 
since the last one." Users of inventories recognize the potential 
influence of vocational interest inaasurement and demand instruments 
that are progressive and futura-oriented. instruments that will widen 
occupational horizons and open the world of work, rather than constrict 
individual development and choice. 

Before attempting interest inventory construction and revision, 

five basic issues must be explored: 
• 1) the criterion sample issue 
Is the instrument fair to men and women? Are social class, race, 
and sex moderator variables? Should different inventories be used with 
different age groups? What are the appropriate criterion and reference 
groups? Do they become out-dated? What does research show about the 

rate of change? 

2) the item pool issue 

Should both sexes respond to the same items? Should activities 
that have traditionally been assigned to one sex be included? Can 
effective items, that are free of socialization effects, be found? 

3) the instructions and directions issue 

How should the instructions address the subject? Do instructions 
limit responses? 
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4) the interpretive Issue 

What are the Implications of administering the men's form to 
women and vice versa? Are sex- role stereotypes of men and women 
presented in interpretive materials? Do the profiles list different 
occupations for men and women? Are manuals and student interpretive 
materials clear that occupations may be for persons of either sex? 
Should scores be reported for males on female-normed scales for which 
there are no male counterparts and vice versa? 

5) the legal issue 

Does the use of popular standardized interest measures in 
employment and education constitute a violation of the civil rights 
of female examinees? What are the implications of Title IX of the 
Education Amendment* 1972» for the continued use of available 
standardized interest meaiurement instruments? What legal questions 
are raised by the use of separate test norms for males and females? 

Solutions to these Issues and questions may be derived from an 
assortment of sources. Empirical data answer many of the technical 
problems and questions; lawyers provide legal guidelines; Inventory users 
submit suggestions and criticisms; advisory committees input 
dec1s1on>making policies; professional commissions contribute expertise 
and objective guidelines. 

Still, many of the Issues have several possible solutions; some 
answers are provisional hypotheses waiting for future proof or disproof, 
and other problems have no Immediate solution. 
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A sixth basic issue for publishers and researchers is finances. 
Who should support the research centers? Who provides the funds to 
guarantee thoughtful and careful inventory development? The 
counselor? The client? The courts? The professional organizations? 
The advisory conmittee? 

Typically, the publisher assumes financial obligation for revisions 
and new editions. Scoring services finance development of computerized 
Interpretations; universities may provide physical space; the federal 
government fmds career education and guidance projects; a small grant 
dribbles in here and there. But the primary financial burden for test 
development remains the publisher's responsibility. 

Caught between researchers requesting money and time to insure 
sound decisions and quality work, and the public expecting the tninedlate 
release of better Instruments, the publisher does not oclupy an 
enviable position. Test users become Impatient v/ith the slow ponderous 
movement of test construction, while researchers envision themselves 
tearing along at braakneck speeds, underfunded and understaffed. 

Globally, Interest inventories are expensive to develop and revise; 
the projects are time consuming. But what, precisely, are the costs? 
What are the expenses of developing new Interpretive methods, of 
intefjrating occupational Interest information with cognitive data, the 
OccMpational Outlook Tandbook . and the Dictionary of OccuDational Titles? 
What are the publishing costs for a new manual? How are "expensive" and 
"time-consuming" defined? By hundreds of dollars or thousands? By 
weeks or months or years? 



Sex bias does occur In career education. The sources of bias must 
be identified; revisions must be made. Developmental cost Is one 
variable that will affect change of interest inventories and 
interpretive methods. 

Revising interest inventories^ 

The steps necess&ry to accomplish the revision of an Instrument 
such as the Strong Vocational Interest Blank (SVIB) are: 1) select 
and revise the item pool* 2) determine a new general reference sample, 
3) revise the existing homogeneous Basic Interest Scales* 4) revise 
the existing empirical Occupational Scales* 5) collect new criterion 
samples* 6) construct new and timely Occupational Scales. 7) provide 
normative and stability data* 8) improve the profile format* 9) update 
test interpretation information, and 10) write a new manual. 

Eight basic requirements must be met before attempting such a 
project; they are: 

1) an archival system with easily retrievable data 

2) a research psychologist, well versed In the desirable 
characteristics pf an Interest Inventory, sophisticated In empirical 
research and statistical analysis, and icnowledgeable of the history 
of the inventory; an Individual with the authority to deteimlne 
priorities 

3) computer programmers sophisticated in programning and 
knowledgeable of the data storage formats and data analysis programs 
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4) research assistants, capable of working v^ith a tnininum of 
supervision, who are familiar with the inventory being revised and 
vocational interests in general 

5) a secretary, skilled in manuscript preparation 

6) clerks, preferably with typing and key punching skills 

7) access to computer facilities and optical scanner 

8) sufficient computer time to facilitate a steady production 

of data 

Thus, the personnel for an ideally staffed research center would 
be one professional, two computer progranroer-research assistants, one 
research fellow, one secretary, and four clerk-typists. The total 
cost per year to staff such a center would be $77,000. 

Machine costs for one year average $10,000, including leases for 
an optical scanner, calculator, key punch, typewriters, and. substantial 
computer time. Materials - paper, computer tapes and cards, printing, 
postage - total $3,000 per year. (Refer to Table 1 for itemized 
estimates of costs for the complete revision of an interest inventory.) 

INSERT TABLE 1 ABOUT HERE 

If the personnel involved are motivated and responsible to the 
project, one can reasonably expect to complete the revision of an 
instrument such as the Strong Vocational Interest Blank in three years 
for a total of $270,000. 
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Constructing new empirical occupational scales 

A pertinent task for test constructors at this time is the addition 
of nev^ scales, v/hich more completely represent the occupational world, 
to current Inventories. Vocational psychologists must now study both 
men and women within an occupation; they must search out men in nursing 
and women in optometry; they must expand their Inventories to Include 
occupations which In the past have been virtual 1^^ closed to one sex or 
the other. 

The addition of even one scale to an interest Inventory creates the 
need for several other changes — readjusting tlK profile, providing 
additional Interpretive Information In the manual, supplying reliability 
and validity data. The major tasks Involved are: 

1) locating an occupational source for selecting subjects; for 
example, finding fewale funeral directors or male dental hygienists 

2) collecting the criterion sample 

3) analyzing the Item statistics 

4) constructing the scale * 

5) computing reliability and validity data 

Assuming that one need not subsidize personnel or machine costs, the 
expenses for developing one scale are $1,935. (Refer to Table 2 for itemized 
material and computer costs.) 



INSERT TABLE 2 ABOUT HERE 
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The tninipum time required to develop a new empirical occupational 
scale is four months. This estimate t iticipates an allotment of 
three weeks for criterion sample collection tasks; 8 weeks for subject 
response, and five W5sks for data analysis and scale construction. 
(Refer to Table 3) 



INSERT table: 3 ABOUT HERE 

Routine tasks » such as compiling a mailing list or editing answer 
3 

sheets, consume an incredible number of hours. For example, one 
person working diligently will take eight days to compile a mailing 
list, another seven days to mail out the sample, and six days to edit 
the returned answer sheets. 
Publishing^ 

Capital outlay over the years by the publisher of an interest 
Inventory, exclusive of research and development costs, represents an 
investment of $100,000 to $115,000. 

The publisher provides editing, design, and management time; supplies 
testing materials; and absorbs thousands of dollars of printing, promotion, 
and publishing costs. Table 4 provides detailed expenses to the 
publisher over a five year period, a realistic time frame for developing 
an inventory properly • ^ 



INSERT TABLE 4 ABOUT HERE 
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Dgvelopinq new interest inventones 

One intcrsst inventory cannot be all inclusive, providing a profile 
reflecting every occupational area and level. Possibly one interest 
inventory cannot be used with all age levels. Perhaps test constructors 
should be preparing inventories designed for specialized groups. 

The decision to develop a new interest inventory versus retain and revise 
an existing inventory must consider the utility of the old versus the new. 
In terms of financial gains, revisions rarely pay off for the amount 
spent. However, new inventories, although more profitable, fail to 
provide an extensive body of published Information on the Inventory 
or longitudinal studies which establish validity for Interpretive data. 

To construct a new Interest Inventory that would feature 30 empirical 
scales, one would need a budget of $340,000 allocated for a t^iree-year 
research period. Personnel alone would use $232,500 of the budget. This 
estimate assumes that the project director Is knowledgeable in the field. 
If the director Is not familiar In detail with the specifics of Interest 
Inventory development, personnel costs could be doubled and project 
time Increased to five or six years. (Refer to Table 5 for personnel, machine, 
and materia'i costs for developing a new Interest Inventory.) 



INSERT TABLE 5 ABOUT HERE 

The $340,000 estimated research budget for developing a new Interest 
Inventory Includes: 1) collecting the Item pool, 2) generating item 
validity and reliability data. 3) designing a test booklet, answer sheet, and 
interpretive profile, 4) collecting criterion samples, 5) constructing 30 
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empirical occupational scales, 6) providing validity, reliability, and 
normative data, 7) preparing test interpretation information, and 
8) writing a new nanual. 

The time expended for research and development of a new. interest 
inventory, or for the revision of an existing inventory, is three years 
minimum. The publisher of the instrument is involved with the project 
for at least a one year organizational period prior to the conrnencement 
of the research, and for an additional year of editing, printing, and 
promotion after the last scale has been constructed. Table 6 provides 
an integrated overview of the time schedules for the three processes: 
revising an interest inventory, developing an Interest inventory, and 
publishing an Interest Inventory. 



Developing comouterized interpretation of Int erest inventories 

The number of scales in Interest inventories has burgeoned during the last 
45 years. The 1928 Manual for the Strong Vocatlmal Interest Blank listed 
12 available occupations, 11 that were under development, and six that 
were expected soon. (Campbell, 1968) The 1966, Fotm T399 and 1968, ¥om TVI398 
revisions of the SVIB each had over 80 scales to be scored. The latest SVIB 
revision. Form T325, the Strong-Campbell Interest Inventory, will have a 
profile with 155 scales. ^ 



INSERT TABLE 6 ABOUT HERE 
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Counselors and clients are faced with a plethora of data — General 
Theme scales based on Holland's theory of vocational types (Campbell 
and Holland, 1972; Hansen and Johansson, 1972), homogeneously constructed 
Basic Interest scales (Campbell, et. al., 1968), empirical Occupational 
scales, anj empirical Non-occupational scales (Campbell, 1971). 

Computerized interpretive profiles assist users of interest 
inventories in comprehending the increased information, and help 
to minimize information overload. 

To develop a computerized interpretive analysis of an interest 
inventory such as the Strong Vocational Interest Blank would require 
three months and approximately $17,000. The project director, a Ph.D. 
psychologist, must be knowledgeable of the interest inventory's 
construction and development as well as interpretive data and methods. 
Supporting staff would include clerical and computer programmer personnel. 
Table 7 details the developmental costs for a computerized interpretive 
analysis of an Interest Inventory. 



INSERT TABLE 7 ABOUT HERE 

Implementing a computerized vocational guidance system^ 

The step beyond computerized interpretive analysis of interest 
Inventories is the complete integration of vocational and educational 
Infonnation into a computerized guidance system. Vocational Interest 
data are used most effectively in conjunction with cognitive data, such 
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as the Differential Aptitude Test B?ittery (DAT), the General Aptitude 
Test Battery (GATB) and Nonverbal Aptitude Test Battery (NATB); the 
nif.tlnr.ar y of Occupational Titles ; the Occtioatlonal Outlook Handbook; 
and an index of job satisfaction. 

The Milwaukee Ccpputerized Educational Guidance System (EDGUYD) 
(Cassel and Mehail, 1973) and the Milwaukee Computerized Vocational 
Guidance System (VOCGUYD) (Cassel and Mehail. 1973) are computer-based 
search and screening modes of operation, designed to assist in the 
narrowing of occupational and educational choices by relating the 
individual's interests with the specific requirements for a particular 
school or job. 

EDGUYD provides orientation and planning experiences for individuals 
making post-high school education plans. The system presents, for the 
subject's personal consideration, all available four-year or highly 
specialized post-high school opportunities within the United States and 
post-high school opportunities of any type within Wisconsin. 

VOCGUYD facilitates the development of vocational maturity among 
secondary students, helping them to narrow personal career choices from 
among 1.112 basic caretr areas to four or five that may be studied more 
intensively and providing them orientation In all areas pertinent to 
career planning and the world of work. 

To implement computerized guidance systems such as VOCGUYD and EDGUYD, 
several basic requirements need to be met: 
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1) one vocational guidance counselor sophisticated in the use of 
instruments such as the Kuder Occupational Interest Inventory (OIS), the 
SVIB, the Ohio Vocational Interest Survey (OVIS). and resource material 
such as the Dictionary of Occupational Titles 

2) one educational guidance counselor sophlsti-^ated in the use of 
Instruments such as the DAT and the GATB 

3) a project director, who may be either (1) or (2) In conjunction 
with other duties, capable of determining priorities with personal 
Involvement in the task 

4) two clerks with key punching skills 

5) computer programmers sophisticated in routine and micro 
programming, with the skills to adapt programs economically to the 
respective computers Involved 

6) sufficient computer facilities, computer time, and materials 
Two additional requirements are essential for using the VOCGUYO and 

EDGUYD systems: 

1) auxiliary programs designed to enlighten'participants about 
testing Instruments such as the Kuder, OVIS, DAT, SVIB 

2) programs to Instruct counselors in new developments In vocational 
and educational psychology such as Bloom's mastery learning, Havighurst's 
critical development stages, and Loevlnger's ego development 

The computerized guidance project expenses would Include two 
professionals, two key punch and clerical personnel, computer time, 
and computer equipment and facilities -- an expense of $57,000. (Refer 
to Table 8 for a detailed estimate of costs.) 
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niSERT TABLE 8 ABOUT HERE 

The cost for the use of such a program, if the requesting agerxy has 
a UHIVAC n08» a DIGITAL PDP-n, or a Honeywell 6000 computer* is from 
$100 to $200 » or the amount necessary to place the programs on a tape 
and transport them to the new agency. 
Discussion 

Ultimately, the elimination of sex bias in career Interest 
inventories will depend on project funding. After the Issues of 
criterion sample, item pool, instructional orientation, interpretation, 
and legality have been settled, researchers and publishers will have 
the guidelines necessary "Tor removing, or at least minimizing, sex 
bias In the use and interpretation of interest inventories. Then 
attention must focus on the issue of finances. 

Interest inventory revisions are costly; development of new 
instruments are equally expensive. For either project, funding must 
Include a yearly $75,000 to $80,000 allowance for personnel. Construction 
of one empirical occupational scale costs $1,900 to $2,000; complete 
revision of an Interest inventory such as the Strong Vocational Interest 
Blank, which represents 45 years of data collection and empirical research, 
costs a minimum of $270,000; the publishing expenses above developmental 
costs are $115,000, bringing the expended furc's to $385,000. 
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Revisions also are time-consumirig. Three years is the absolute 
minimum estimate for a'^complete revision. Construction of a new 
inventory, providing only 20 percent of the scores presented on an 
instrument such as the Strong-CampbeVl Interest Inventory, exhausts 
three years. The development of one, empirical scale requires at least 
four months. 

To increase the activity of Interest inventory research, financial 
support for researchers must increase. Possible funding sources include: 

1) continued support by publishers, universities and scoring 
services 

2) increased monies through federal funding 

3) aid from professional organizations 

4) funding from special interest groups 

Unfortunately, wittMut outside financial aid and assistance, much 
interest inventory research may be forced to halt, and needed revisions 
of interest inventories may be impossible to accomplish. 
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Footnotes 

^ Cost estimates obtained fron the Center for Interest Measurement 
Research, University of Minnesota. Minneapolis, Minnesota. 

• 

^ Cost and time estinates obtained from the Center for Interest Measurement 
Research, University of Minnesota, Minneapolis, Minnesota. 

^ To facilitate accurate optical scanning of item responses, each answer 
sheet must be examined to ensure that all items are answered, that the 
marks are dark, and that the name grid is properly completed. 

* Cost estimates based on infonnation obtained from Mr. Leon Seltzer, Director, 
Stanford University Press, Stanford, California. 

^ Cost estimates based on Information obtained from Dr. Charles B. 
Johansson, Director of Test Development, National Computer Systems, 
Ml nneapol 1 s » Ml nnesota . 

^ Cost estimates based on Information obtained from Dr. Charles 8. Johansson, 
Director of Test Development, National Computer Systems, Minneapolis, 
Minnesota. 

^ Cost estimates based on Information obtained frow Dr. Russell N. CasselU 
Professor of Educational Psychology, University of Wisconsin - Milwaukee^ 
Milwaukee, Wisconsin. 
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